"Hey Copilot" surprise from Microsoft: All computers will talk to artificial intelligence
Microsoft has made its anticipated big announcement. Comprehensive AI updates are coming to Windows 11. The company announced that with this update, not only "Copilot+ PC" owners but all Windows 11 users will now benefit from the AI-powered experience.
Microsoft's Consumer Marketing Director, Yusuf Mehdi, summarized the new era in his statement as follows:
"With the new updates, every Windows 11 PC becomes an AI computer. At its heart is Copilot."
"HEY COPILOT" ERAThanks to the Copilot Voice feature added to Windows 11, users can now activate artificial intelligence by saying “Hey Copilot.”
After this command, a microphone icon will appear on the screen and the user will be able to ask questions to Copilot or initiate actions with voice commands.
This feature will be optionally enabled via settings.
UNDERSTAND EVERYTHING ON THE SCREENMicrosoft is also rolling out Copilot Vision, a feature currently available in the US, globally. With user permission, this system can analyze on-screen content to offer help suggestions. For example, it can explain how to use an app, suggest solutions to errors, or provide tips for playing a game.
When Copilot Voice and Vision work together, the user will be able to perform actions on their computer simply by speaking.
The new update will also include a search box called "Ask Copilot" on the taskbar. From there, users will be able to access Copilot Voice and Copilot Vision with a single click. The search experience will also be significantly improved in terms of speed and accuracy.
ARTIFICIAL INTELLIGENCE INTERACTING WITH FILESMicrosoft's most striking innovation is Copilot Actions. Previously tested on the web, this feature is now available for computer files. In the new "experimental mode," Copilot can be given commands like "sort my vacation photos" and "find meeting notes in this document." The AI will interact with desktop applications, performing these actions like human users by "clicking, typing, and swiping."
Microsoft emphasizes that it will test this feature "slowly and carefully." Special security measures will be taken; for example, Copilot will only be able to access files that the user has permission to access.
NEW VEHICLE "MANUS"Another new feature introduced for Windows 11 is a general-purpose AI agent called “Manus,” which can perform complex tasks.
For example, the user can ask to automatically create a website using documents and images in a folder.
INTEGRATION WITH GMAILCopilot will also integrate with external services like Gmail through new connectors. This will allow users to ask questions like, "Show me my meetings in Google Calendar." Copilot will also take a more active role in managing computer settings.
Microsoft announced that it has established comprehensive policies to ensure the security of this new system, which it describes as "agent-based." The company announced that it will limit user permissions and take precautions against new types of cyberattacks, such as prompt injections.
Mehdi emphasized that voice interaction will become an interface as fundamental as the keyboard and mouse in the future:
"When people communicate with Copilot using voice rather than text, the engagement rate doubles. This transformation will revolutionize computing as much as the mouse and keyboard."
ntv
